mod_proxy issue - intermittent 502 response

mod_proxy issue - intermittent 502 response

am 26.11.2009 18:18:46 von Cristian Pini

--_000_4DBC2201FA1D2E4299DC5FDC726ADEC8ED537C54BEgserverhqfs it_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Hi,

I'm running Apache/2.0.52 as a reverse proxy on a RHE4 box, the backend app=
server is on a separate machine again RHE4, running Apache/2.0.52 and mod_=
perl 1.99_16.

There are intermittent 502 responses being generated by the proxy although =
a page refresh generally resolves the issue, we are trying to get a configu=
ration of 2 RP boxes in front of 3 mod_perl app servers into production but=
will need to understand / resolve the issue of these intermittent 502 resp=
onses first.

[Thu Nov 26 15:35:09 2009] [error] [client 88.96.233.45] proxy: error readi=
ng status line from remote server xxx.xxxxxx.co.uk, referer: http://xxx.xxx=
x.co.uk/mens/casual/casual/71/brand-/all-/start-
[Thu Nov 26 15:35:09 2009] [error] [client 88.96.233.45] proxy: Error readi=
ng from remote server returned by /mens/smart/smart/70/brand-/all-/start-, =
referer: http://xxxx.xxxxxxx.co.uk/mens/casual/casual/71/brand-/all-/ start-

Can someone shed further light on what the problem is and how to resolve it=
pls, I'm happy to send virtual host confs if someone wishes to dig little =
deeper. Note at this point I'm using mod_rewrite [P] to proxy the requests =
to the app server rather than using ProxyPass as we have many rewrites in t=
he conf.

I've googled around and have seen that others have observed similar scenari=
os when using this setup in Apache 2.0 but have not seen anything specific =
about a resolution or path to resolution.

Your help gratefully appreciated.

Kind regards,

Cris

Cristian Pini
Foresite Business Solutions Ltd
Tel: 020 8540 0040
Direct: 020 8545 6813
http://www.fsite.com


--_000_4DBC2201FA1D2E4299DC5FDC726ADEC8ED537C54BEgserverhqfs it_
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

hemas-microsoft-com:office:word" xmlns:st1=3D"urn:schemas-microsoft-com:off=
ice:smarttags" xmlns=3D"http://www.w3.org/TR/REC-html40">




name=3D"PersonName"/>









0.0pt;
font-family:Arial'>Hi,



0.0pt;
font-family:Arial'> 



0.0pt;
font-family:Arial'>I’m running Apache/2.0.52 as a reverse proxy on a =
RHE4
box, the backend app server is on a separate machine again RHE4, running
Apache/2.0.52 and mod_perl 1.99_16.



0.0pt;
font-family:Arial'> 



0.0pt;
font-family:Arial'>There are intermittent 502 responses being generated by =
the
proxy although a page refresh generally resolves the issue, we are trying t=
o
get a configuration of 2 RP boxes in front of 3 mod_perl app servers into
production but will need to understand / resolve the issue of these
intermittent 502 responses first.



0.0pt;
font-family:Arial'> 



e:10.0pt;
font-family:Arial;font-style:italic'>[Thu Nov 26 15:35:09 2009] [error] [cl=
ient
88.96.233.45] proxy: error reading status line from remote server
xxx.xxxxxx.co.uk, referer: http://xxx.xxxx.co.uk/mens/casual/casual/71/bran=
d-/all-/start-



e:10.0pt;
font-family:Arial;font-style:italic'>[Thu Nov 26 15:35:09 2009] [error] [cl=
ient
88.96.233.45] proxy: Error reading from remote server returned by
/mens/smart/smart/70/brand-/all-/start-, referer: http://xxxx.xxxxxxx.co.uk=
/mens/casual/casual/71/brand-/all-/start-



0.0pt;
font-family:Arial'> 



0.0pt;
font-family:Arial'>Can someone shed further light on what the problem is an=
d
how to resolve it pls, I’m happy to send virtual host confs if someon=
e
wishes to dig little deeper. Note at this point I’m using mod_rewrite=
[P]
to proxy the requests to the app server rather than using ProxyPass as we h=
ave
many rewrites in the conf.



0.0pt;
font-family:Arial'> 



0.0pt;
font-family:Arial'>I’ve googled around and have seen that others have
observed similar scenarios when using this setup in Apache 2.0 but have not
seen anything specific about a resolution or path to resolution.=



0.0pt;
font-family:Arial'> 



0.0pt;
font-family:Arial'>Your help gratefully appreciated.
t>



0.0pt;
font-family:Arial'> 



0.0pt;
font-family:Arial'>Kind regards,



0.0pt;
font-family:Arial'> 



0.0pt;
font-family:Arial'>Cris



0.0pt;
font-family:Arial'> 



silver
face=3DArial> r;
font-weight:bold'>Cristian Pini
color=3Dsilver> pan>



=3D'font-size:
10.0pt;font-family:Arial;color:silver'>Foresite Business Solutions Ltd n>
color=3Dsilver>



=3D'font-size:
10.0pt;font-family:Arial;color:silver'>Tel: 020 8540 0040
=



=3D'font-size:
10.0pt;font-family:Arial;color:silver'>Direct: 020 8545 6813
<=
font
color=3Dsilver>



=3D'font-size:
10.0pt;font-family:Arial;color:silver'>http://www.fsite.com
ont
color=3Dsilver>



'font-size:
12.0pt'> 









--_000_4DBC2201FA1D2E4299DC5FDC726ADEC8ED537C54BEgserverhqfs it_--

RE: mod_proxy issue - intermittent 502 response

am 27.11.2009 10:16:47 von Boyle Owen

502 is bad gateway, which means that apache and the back-end server have
got into a protocol argument. Usually this is due to a bad response from
the back-end (as your log entries indicate). Why do you think apache is
the problem?

Rgds,
Owen Boyle
Disclaimer: Any disclaimer attached to this message may be ignored. =20


________________________________

From: Cristian Pini [mailto:cris.pini@fsite.com]=20
Sent: Thursday, November 26, 2009 6:19 PM
To: users@httpd.apache.org
Subject: [users@httpd] mod_proxy issue - intermittent 502
response
=09
=09

Hi,

=20

I'm running Apache/2.0.52 as a reverse proxy on a RHE4 box, the
backend app server is on a separate machine again RHE4, running
Apache/2.0.52 and mod_perl 1.99_16.=20

=20

There are intermittent 502 responses being generated by the
proxy although a page refresh generally resolves the issue, we are
trying to get a configuration of 2 RP boxes in front of 3 mod_perl app
servers into production but will need to understand / resolve the issue
of these intermittent 502 responses first.

=20

[Thu Nov 26 15:35:09 2009] [error] [client 88.96.233.45] proxy:
error reading status line from remote server xxx.xxxxxx.co.uk, referer:
http://xxx.xxxx.co.uk/mens/casual/casual/71/brand-/all-/star t-

[Thu Nov 26 15:35:09 2009] [error] [client 88.96.233.45] proxy:
Error reading from remote server returned by
/mens/smart/smart/70/brand-/all-/start-, referer:
http://xxxx.xxxxxxx.co.uk/mens/casual/casual/71/brand-/all-/ start-

=20

Can someone shed further light on what the problem is and how to
resolve it pls, I'm happy to send virtual host confs if someone wishes
to dig little deeper. Note at this point I'm using mod_rewrite [P] to
proxy the requests to the app server rather than using ProxyPass as we
have many rewrites in the conf.

=20

I've googled around and have seen that others have observed
similar scenarios when using this setup in Apache 2.0 but have not seen
anything specific about a resolution or path to resolution.

=20

Your help gratefully appreciated.

=20

Kind regards,

=20

Cris

=20

Cristian Pini

Foresite Business Solutions Ltd

Tel: 020 8540 0040

Direct: 020 8545 6813

http://www.fsite.com=20
=20
This message is for the named person's use only. It may contain =
confidential, proprietary or legally privileged information. If you =
receive this message in error, please notify the sender urgently and =
then immediately delete the message and any copies of it from your =
system. Please also immediately destroy any hardcopies of the message.=20
The sender's company reserves the right to monitor all e-mail =
communications through their networks.

------------------------------------------------------------ ---------
The official User-To-User support forum of the Apache HTTP Server Project.
See for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org

RE: RE: mod_proxy issue - intermittent 502 response

am 27.11.2009 10:52:17 von Cristian Pini

Thx for taking the time to read the post.

You're right in that it's difficult to determine whether Apache is the prob=
lem, however, there's nothing sitting between the proxy and the app server =
and the only things that are running on the app server are apache (mod_perl=
) and sendmail.

Having reviewed the access and error log on the proxy I can see an entry fo=
r a request that subsequently fails, however, neither the access or error l=
ogs on the app server have an entry for the request. This suggests that the=
request is never reaching the app server but as there's only one hop betwe=
en them I'm struggling to understand what is happening to the request from =
the proxy.

Rgds,

Cris

-----Original Message-----
From: Boyle Owen [mailto:Owen.Boyle@six-group.com]
Sent: 27 November 2009 09:17
To: users@httpd.apache.org
Subject: RE: [users@httpd] mod_proxy issue - intermittent 502 response

502 is bad gateway, which means that apache and the back-end server have
got into a protocol argument. Usually this is due to a bad response from
the back-end (as your log entries indicate). Why do you think apache is
the problem?

Rgds,
Owen Boyle
Disclaimer: Any disclaimer attached to this message may be ignored.


________________________________

From: Cristian Pini [mailto:cris.pini@fsite.com]
Sent: Thursday, November 26, 2009 6:19 PM
To: users@httpd.apache.org
Subject: [users@httpd] mod_proxy issue - intermittent 502
response



Hi,



I'm running Apache/2.0.52 as a reverse proxy on a RHE4 box, the
backend app server is on a separate machine again RHE4, running
Apache/2.0.52 and mod_perl 1.99_16.



There are intermittent 502 responses being generated by the
proxy although a page refresh generally resolves the issue, we are
trying to get a configuration of 2 RP boxes in front of 3 mod_perl app
servers into production but will need to understand / resolve the issue
of these intermittent 502 responses first.



[Thu Nov 26 15:35:09 2009] [error] [client 88.96.233.45] proxy:
error reading status line from remote server xxx.xxxxxx.co.uk, referer:
http://xxx.xxxx.co.uk/mens/casual/casual/71/brand-/all-/star t-

[Thu Nov 26 15:35:09 2009] [error] [client 88.96.233.45] proxy:
Error reading from remote server returned by
/mens/smart/smart/70/brand-/all-/start-, referer:
http://xxxx.xxxxxxx.co.uk/mens/casual/casual/71/brand-/all-/ start-



Can someone shed further light on what the problem is and how to
resolve it pls, I'm happy to send virtual host confs if someone wishes
to dig little deeper. Note at this point I'm using mod_rewrite [P] to
proxy the requests to the app server rather than using ProxyPass as we
have many rewrites in the conf.



I've googled around and have seen that others have observed
similar scenarios when using this setup in Apache 2.0 but have not seen
anything specific about a resolution or path to resolution.



Your help gratefully appreciated.



Kind regards,



Cris



Cristian Pini

Foresite Business Solutions Ltd

Tel: 020 8540 0040

Direct: 020 8545 6813

http://www.fsite.com

This message is for the named person's use only. It may contain confidentia=
l, proprietary or legally privileged information. If you receive this messa=
ge in error, please notify the sender urgently and then immediately delete =
the message and any copies of it from your system. Please also immediately =
destroy any hardcopies of the message.
The sender's company reserves the right to monitor all e-mail communication=
s through their networks.

------------------------------------------------------------ ---------
The official User-To-User support forum of the Apache HTTP Server Project.
See for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


------------------------------------------------------------ ---------
The official User-To-User support forum of the Apache HTTP Server Project.
See for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org

Re: RE: mod_proxy issue - intermittent 502 response

am 27.11.2009 11:00:00 von Tom Evans

--00c09f8a5576e372ba0479575aba
Content-Type: text/plain; charset=UTF-8

On Fri, Nov 27, 2009 at 9:52 AM, Cristian Pini wrote:

> Thx for taking the time to read the post.
>
> You're right in that it's difficult to determine whether Apache is the
> problem, however, there's nothing sitting between the proxy and the app
> server and the only things that are running on the app server are apache
> (mod_perl) and sendmail.
>
> Having reviewed the access and error log on the proxy I can see an entry
> for a request that subsequently fails, however, neither the access or error
> logs on the app server have an entry for the request. This suggests that the
> request is never reaching the app server but as there's only one hop between
> them I'm struggling to understand what is happening to the request from the
> proxy.
>
> Rgds,
>
> Cris
>
>
The 502 error basically says that the proxy couldn't connect to the backend
or that the backend responded with something that it couldn't understand.
Examine your network, your backend app and tcpdump the entire exchange. It
is unlikely to have much to do with the proxy, which is why googling for a
solution to your proxy errors did not return anything of note - this is
almost always either the backend not coping, or the network not coping.

Cheers

Tom

--00c09f8a5576e372ba0479575aba
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

On Fri, Nov 27, 2009 at 9:52 AM, Cristian Pini <=
span dir=3D"ltr"><cris.pini@fsite=
..com
> wrote:
rder-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding=
-left: 1ex;">
Thx for taking the time to read the post.



You're right in that it's difficult to determine whether Apache is =
the problem, however, there's nothing sitting between the proxy and the=
app server and the only things that are running on the app server are apac=
he (mod_perl) and sendmail.




Having reviewed the access and error log on the proxy I can see an entry fo=
r a request that subsequently fails, however, neither the access or error l=
ogs on the app server have an entry for the request. This suggests that the=
request is never reaching the app server but as there's only one hop b=
etween them I'm struggling to understand what is happening to the reque=
st from the proxy.




Rgds,



Cris




The 502 error basically says that the proxy co=
uldn't connect to the backend or that the backend responded with someth=
ing that it couldn't understand. Examine your network, your backend app=
and tcpdump the entire exchange. It is unlikely to have much to do with th=
e proxy, which is why googling for a solution to your proxy errors did not =
return anything of note - this is almost always either the backend not copi=
ng, or the network not coping.


Cheers

Tom


--00c09f8a5576e372ba0479575aba--

Re: RE: mod_proxy issue - intermittent 502 response

am 27.11.2009 12:25:06 von Zach Uram

Make sure there is no firewall rules blocking it.

Zach

------------------------------------------------------------ ---------
The official User-To-User support forum of the Apache HTTP Server Project.
See for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org

RE: mod_proxy issue - intermittent 502 response

am 27.11.2009 14:31:37 von Haroon Rafique

On Today at 9:52am, CP=>Cristian Pini wrote:

CP> Thx for taking the time to read the post.
CP>

Hi,

Have you looked at "Protocol Adjustments" at:
http://httpd.apache.org/docs/2.2/mod/mod_proxy.html#envsetti ngs
Those settings recently helped me get rid of intermittent 502 errors.

Hope that helps,

CP>
CP> You're right in that it's difficult to determine whether Apache is the
CP> problem, however, there's nothing sitting between the proxy and the
CP> app server and the only things that are running on the app server are
CP> apache (mod_perl) and sendmail.
CP>
CP> Having reviewed the access and error log on the proxy I can see an
CP> entry for a request that subsequently fails, however, neither the
CP> access or error logs on the app server have an entry for the request.
CP> This suggests that the request is never reaching the app server but as
CP> there's only one hop between them I'm struggling to understand what is
CP> happening to the request from the proxy.
CP>
CP> Rgds,
CP>
CP> Cris
CP>

--
Haroon Rafique



------------------------------------------------------------ ---------
The official User-To-User support forum of the Apache HTTP Server Project.
See for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org